NASA/CR- 


— 207497 


ju a4 macao - 3 9s i 


March 2, 1998 


Validation of the Version 1 NO A A/NAS A Pathfinder 
Sea Surface Temperature Data Set 


Elizabeth A. Smith 
Research Assistant Professor 
Center for Coastal Physical Oceanography 
Department of Ocean, Earth and Atmospheric Sciences 
Old Dominion University 


/N 




/<L_ 


y 


1. Background 

A high-resolution, global satellite-derived sea surface temperature (SST) data set called 
Pathfinder, from the Advanced Very High Resolution Radiometer (AVHRR) aboard the 
NOAA Polar Orbiters, is available from the Jet Propulsion Laboratory Physical Oceanography 
Distributed Active Archive Center (JPL PO.DAAC). Suitable for research as well as 
education, the Pathfinder SST data set is a result of a collaboration between the National 
Oceanographic and Atmospheric Administration (NOAA), the National Aeronautics and Space 
Administration (NASA) and investigators at several universities. NOAA and NASA are the 
sponsors of the Pathfinder Program, which takes advantage of currently archived Earth science 
data from satellites. Where necessary, satellite sensors have been intercalibrated, algorithms 
improved and processing procedures revised, in order to produce long time-series, global 
measurements of ocean, land and atmospheric properties necessary for climate research. 

Many Pathfinder data sets are available to researchers now, nearly a decade before the first 
launch of NASA’s Earth Observing System (EOS). The lessons learned from the Pathfinder 
programs will facilitate the processing and management of terabytes of data from EOS. The 
Oceans component of Pathfinder has undertaken to reprocess all Global Area Coverage (GAC) 
data acquired by the 5-channel AVHRRs since 1981. The resultant data products are 
consistent and stably calibrated [Rao, 1993a, Rao, 1993b, Brown et al., 1993)], Earth-gridded 
SST fields at a variety of spatial and temporal resolutions. 

2. Introduction 

This technical report describes a statistical analysis of the Version 1 Pathfinder SST data set, 
as compared with global moored and drifting buoy data from the AVHRR Pathfinder Oceans 
Matchup Database 1985-1993 (Version 18) which was produced by the Remote Sensing 
Group at the University of Miami, Rosenstiel School of Marine and Atmospheric Sciences 
(Podesta et al, 1995). Section 3 contains a description of the methods and algorithms used to 
derive SST from AVHRR measurements. A discussion of AVHRR Pathfinder Version 1 
algorithms will be covered in this section. Geophysical factors effecting the accuracy of 
satellite-derived estimates of SST are discussed briefly in Section 4. Section 5 contains a 
discussion of the validation analyses and results. 
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Since 1993, the PO.DAAC at JPL has been distributing daily, global AVHRR-derived SST 
fields from the NOAA/NASA AVHRR Pathfinder Program. Data for the period from January 
1987 - May 1991 have been distributed to hundreds of users. These data were processed 
using approved Pathfinder AVHRR Version 1 algorithms and coefficients (Vazquez, 1995 
User’s Guide). In June of 1997, a new Pathfinder SST algorithm was approved by the 
Science Working Group, known as Version 4 (Evans et al, 1996, Vazquez, 1996). The JPL 
PO.DAAC is in the process of reprocessing all of the AVHRR data using the Version 4 
algorithms. For a description of data availability and a discussion of the Version 4 
algorithms, see http://podaac.jpl.nasa.gov/sst/, which is the JPL PO.DAAC WWW homepage 
for the Pathfinder data. 


3. Description of Version 1 Algorithms and Coefficients for the 
Pathfinder SST Project 

The AVHRR Level- IB sensor counts in the visible channels (1 and 2) are first converted to 
Rayleigh-corrected radiances and then to optical depth for use in removing the effects of the 
atmosphere and viewing and illumination geometry. Channels 3, 4 and 5 are transformed to 
units of "brightness temperature", using the Planck black body function and a 
newly-determined correction for sensor calibration non-linearity in the longer-wavelength 
channels (Brown et al., 1993). Version 1 (VI) of the Pathfinder SST algorithm is essentially 
the nonlinear SST (NLSST) (Walton, 1988), with a modification for sensor calibration drift 
with time. The VI algorithm is also conditioned in three different atmospheric regimes based 
on the difference between Channel 4 and Channel 5 (Ch. 4 minus Ch. 5), and unique 
regression coefficients are applied in each regime. The form of the VI algorithm is: 

SST = a + b*T4 + c*(T4-T5)*Tsurf + d*(sec(q)-l)*(T4-T5) + e*lifetime (1) 

where q is the zenith angle of the instrument, and T4 and T5 are the brightness temperatures 
from AVHRR channels 4 and 5, respectively, as determined using the procedure outlined in 
NOAA Technical Report NESDIS 69. Tsurf is an a-priori estimate of the SST. It is derived 
from the 1 -degree optimum interpolated SST analysis produced by Dr. Richard Reynolds of 
NOAA/NESDIS (Reynolds and Smith, 1994), which has been interpolated to the nominal 9km 
grid. The spatial interpolation used is a bilinear interpolation of the 4 closest neighboring 
points surrounding the nominal 9km grid point. The empirical coefficients a, b, c, d, and e 
are determined through a multiple-regression of AVHRR radiances with a database of in-situ 
temperatures, measured using moored and drifting buoys (Podesta, 1995). These coefficients 
are calculated for one year at a time, in three atmospheric regimes as defined by the 
difference between T4 and T5. To be considered a match, the pixel location of the satellite- 
derived measurement and in-situ measurement must fall within 0.1 degree spatially, and 30 
minutes of one another. Recently, the AVHRR thermal vacuum test data have been 
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examined in detail (Brown et. al., 1993) in order to quantify the temporal drift in the 
calibration of the AVHRR channels. Through this work, the nonlinear SST algorithm first 
developed by Walton (1988) was modified with a time-dependent term, called lifetime in (1). 

Table 1 shows the coefficients used in deriving the sea surface temperatures for the Version 1 
Pathfinder SST data set for 1987-1988. 

Table 1 

NOAA-9: for years 1987 and 1988, not valid before 1987 


a 

b 

c 

d 

e 

channel 4-5 range 

1.600 

0.930 

0.149 

0.085 

-0.029 

<0.7 

2.202 

0.953 

0.089 

0.673 

-0.086 

0.7< 1.8 

4.470 

0.868 

0.090 

0.439 

-0.176 

=1.8 


NOAA-11: valid from launch Nov. , 1988 until May , 1991; not valid afterwards. 


a 

b 

c 

d 

e 

channel 4-5 ranee 

1.011 

0.934 

0.120 

1.118 

0.026 

<0.7 

1.336 

0.945 

0.087 

0.984 

0.003 

0.7 < 1.8 

3.250 

0.869 

0.078 

0.805 

0.009 

= 1.8 


4. Summary of Known Errors 

Much work has been done to date to identify and quantify the variability of AVHRR-derived 
SST measurements. At any given location we know the SST variability (the departure from 
the climatological mean) may range from a few tenths of a degree to as much as 5-7 degrees 
(under El Nino conditions, for instance). SST algorithms must be robust in order to work 
under a this range of environmental conditions. Described below are some of the better 
understood sources of error in the retrieval of satellite SSTs. 

a. Differences between the skin and the bulk temperature 
Multichannel algorithms for estimating SST from the AVHRR, such as the MCSST, NLSST 
and Pathfinder NLSST, do not take into account the difference between the ocean’s skin 
temperature (what the AVHRR actually sees and measures) and underlying mixed layer SST 
which is referred to as the "bulk" temperature. The "bulk" temperature is the quantity 
measured by most buoys. The uppermost millimeter of the ocean, or skin, can be as much as 
0.7 °C cooler than the water just below ( Ewing and McAlister, 1960) due to evaporative or 
radiative cooling. Conditioning the satellite-derived SST estimates using buoys, as is done in 
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the Pathfinder SST algorithms and their predecessors, results in a measurement which more 
closely resembles a "bulk" SST estimate, not a skin estimate ( Schluessel et al., 1990). 

b. Problems with buoys 

In situ measurement of SST is a complicated task, and hence, there is the potential that errors 
exist both in archived in situ SSTs and in satellite SST derivation procedures using in situ 
SST. Heating or cooling of the sea surface occurs as a result of air-sea fluxes, horizontal and 
vertical heat advection, and mixing. It is the nature of the air-sea fluxes of heat that 
complicates the measurement of SST in the ocean. 

c. Cloud contamination 

A significant limitation of satellite-derived SST measurements is the inability to make 
AVHRR SST measurements in the presence of clouds. Most of the time, this limitation is 
overcome by performing temporal averaging or compositing over weeks and months, and over 
large spatial scales. For some applications, this is not always feasible. In regions of 
persistent high cloudiness, even monthly composites exhibit data voids. Cloud detection 
techniques are generally applied globally and in an automated fashion especially when global 
data sets are produced in an operational environment. The drawback to such techniques is 
that there will inevitably be mistakes because of the strong regional and temporal variability 
in cloud formation and movement. Cloudy pixels will be determined to be valid SSTs and 
perfectly good SSTs will be discarded as clouds. For the Pathfinder SST data sets, these 
cloud detection techniques are being carefully scrutinized. 

d. Aerosols and water vapor 

SST estimates in regions of high humidity (such as the western equatorial Pacific Ocean) 
require large atmospheric corrections. Likewise, volcanic aerosols, such as were detected in 
the stratosphere in abundance following the eruptions of El Chichon in 1982 and again in 
1991 after Mt. El Pinatubo erupted in the Philippines, have been found to bias the SST 
retrievals anomalously low. 

5. Validation Approach 

The objective of this grant was to provide validation statistics for the Version 1 Pathfinder 
SST global data set for 1987-1990. 

a. Description of Version 1 Pathfinder SST Data 
The data used in this validation study are daily gridded fields with a nominal spatial 
resolution of 9 kilometers. Ascending and descending passes are separated during production 
and hence considered separately during analysis. For this study, to reduce the data volume, 
only the de-clouded data (a.k.a., the best SST) are considered. The SST algorithms are as 
described in Section 3 above. 
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b. Description of the AVHRR Pathfinder Oceans Matchup Database( 1987- 1990) 
Version 18. 

The in situ SST data set against which the satellite-derived Pathfinder SST observations are 
compared is the AVHRR Pathfinder Oceans Matchup Database( 1987- 1990) Version 18. This 
is a multi-satellite, multi-year database of AVHRR and high-quality, in situ SST matchups. 

The in situ SST data come from two sources, moored and drifting buoys, from a variety of 
agencies and programs worldwide. 

6. Results 

Figure 1 shows the global distribution of the moored and drifting buoy data in the Version 1 
Matchup data base for the period 1987-1990. Coverage is excellent in some regions (eastern 
Equatorial Pacific Ocean) and poor in others (tropical Atlantic and Indian Oceans). There are 
an order of magnitude more moored buoy observations of SST in the Northern Hemisphere 
than the Southern Hemisphere. On the other hand, there are more drifter data in the Southern 
Hemisphere than the Northern Hemisphere. Figure 2 shows the distribution of moored and 
drifting buoy data for 1987, a representative year. 

A residual is defined as buoy SST minus the satellite-derived Pathfinder SST. Residuals and 
Root Mean Square (RMS) errors are computed for every matchup pair for each day from 
January 1987 thru April 1991 and shown as a time series in Figure 3. The average residual 
(also called bias) is O.O80C and the average RMS error is 0.82oC. A small positive bias of 
O.O80C indicates that, globally, the Pathfinder SST satellite-derived data are slightly cooler 
than the buoy SST data. Cloud contamination in the Pathfinder SST fields would explain this 
low bias as would the presence of water vapor in the atmosphere. 

Separating the matchup pairs of buoy and Pathfinder SST based upon latitude and then 
computing the statistics helps elucidate the mechanisms contributing to the computed 
residuals. Figures 4 and 5 show time series plots of residuals and RMS errors, respectively, 
for three bands of latitude; 20N to 50N, 20N to 20S and 20S to 50S. Average residuals in the 
subtropical northern latitudes (top panel of Figure 4) are negative, meaning the Pathfinder 
SST data are warmer than the buoy SSTs. The RMS errors for the subtropical northern 
latitudes (top panel of Figure 5) show a seasonal cycle with largest RMS errors in the summer 
months. Large RMS errors correspond to periods of negative residuals for latitudes north of 
20N. Negative residuals in the summer months in the northern hemisphere subtropics are 
probably a result of intense solar heating of the ocean’s skin in the subtropical gyres, in the 
presence of low winds. Since the AVHRR instrument measures of this skin temperature, it is 
not surprising that the Pathfinder SST data are biased warm north of 20N. 

The highest average residuals are found in the tropics (middle plot of Figure 4), where 
atmospheric water vapor is high. Variability in the tropics is lower than either the subtropical 
northern or southern latitudes. Water vapor in the atmosphere is the most likely contributing 
mechanism to the observed warm bias in the tropics. 
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In addition to computing residuals and RMS errors globally, they were computed for six 
oceanic regions, for each year; Eastern Tropical Pacific Ocean, East Coast of North 
America/Gulf of Mexico, North Atlantic Ocean, Southern Indian & Atlantic Oceans, West 
Coast of North America/Eastem Pacific and the Indian Ocean. Table 2-Table 5 show these 
results. Negative residuals between the Pathfinder SST and the in situ data are seen for each 
year in East Coast of North America/Gulf of Mexico region. As was discussed in the 
previous paragraph, a warm bias such as this is probably the result of the satellite measuring 
the warmer skin layer of the ocean, and the buoy measuring the bulk SST. The smallest 
residuals are computed for observations in the West Coast of North America/Eastem Pacific 
while the largest residuals are found in the Indian Ocean, where there is a strong seasonal 
cycle. More interpretation of these regional results is currently underway with the 
introduction of a satellite- derived water vapor data set from the Special Sensor Microwave 
Imager in order to elucidate the role of water vapor in biasing satellite SST measurements. 
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Geographic distribution of buoy/satellite matchups for NOAA-9 and NOAA-I I (1987 1990) 



1987 - ZONAL DISTRIBUTION of MATCHUPS 

1 1 1 1 1 1 1 1 1 T- 1 


2000 

r T T 1 1 r T T | T T T 1 

1 T T 


MOORED BUOYS 


- 

1500 




— 


daytime - solid line 


- 

o> 

§- 

nighttime • dotted line 


- 

•c 

o 

- 


“ 

1 

- 


“ 

s 1000 

— 


— 

fc-. 



- 

Q> 




£ 









_ 

500 

— 






0 

i - . t . ' i l.«J 


. . 1 

- 


-50 0 50 

Latitude 



Figure 2 




1987-1991 Residuals (buoy minus satellite) - DAY & NIGHT 




(0 saaj6ap) jojjg SWU 


Figure 3 


Residuals - 50N to 20N (day & night) 



Figure 4 




RMS Error - 50N to 20N (day & night) 



(O S33j6ap) jojj3 swb (0 saajBap) JO.ua SWU (0 saajBap) jojj3 SWd 


Figure 5 




This table shows a summary of the statistics for 1987 satellite/buoy matchups. 


REGION 


Global 



Eastern Trop. 
Pacific 



East Coast 
NA & G.O.M 



North Atlantic 



S. Indian & S. 
Atlantic 



West Coast 
NA & Eastern 
Pacific 



Indian Ocean 



Day/Night 

RMSD 

BIAS 

day&night 

0.96 

0.05 

day 

0.94 

0.01 

night 

0.97 

0.09 

day&night 

0.68 

0.39 

day 

0.56 

0.26 

night 

0.74 

0.49 

day&night 

0.89 

-0.24 

day 

0.75 

-0.20 

night 

0.97 

-0.26 

day&night 

1.13 

0.15 

day 

1.22 

0.10 

night 

0.99 

0.22 

day&night 

1.24 

0.61 

day 

1.17 

0.49 

night 

1.31 

0.74 

day&night 

0.76 

-0.04 

day 

0.71 

-0.07 

night 

0.79 

-0.01 

day&night 



day 

1.42 

-0.62 


1.15 

0.10 






observations 


9616 


4234 


5382 


1953 


783 


1170 


2002 


819 


1183 


220 


129 


91 


1241 


648 


593 


2376 


997 


1379 


215 


104 


111 


Table 2 































































































REGION 


Global 



Eastern Trop. 
Pacific 



East Coast 
NA & G.O.M 



North Atlantic 



S. Indian & S. 
Atlantic 



West Coast 
NA & Eastern 
Pacific 



Day/Night 

RMSD 

day&night 

0.80 

day 

0.76 

night 

0.82 

day&night 

0.64 

day 

0.57 

night 

0.68 

day&night 

0.82 

day 

0.70 

night 

0.89 

day&night 

1.15 

day 

1.24 

night 

0.96 

day&night 

1.08 

day 

0.93 

night 

1.23 

day&night 

0.78 

day 

0.83 

night 

0.74 



0.26 0.55 


0.42 0.45 


-0.21 0.40 


-0.12 -0.09 


-0.27 0.54 


0.41 -1.49 


0.37 1.90 


0.48 -1.32 


0.35 0.47 


0.22 -0.26 


0.51 0.33 


-0.04 0.58 


-0.03 -0.13 


-0.05 0.47 


observations 


8834 


3930 


4904 


2348 


963 


1385 


2472 


1028 


1444 


181 


119 


62 


733 


414 


359 


2401 


1034 


1367 
















































































REGION 


Global 



Eastern Trop. 
Pacific 



East Coast 
NA & G.O.M 



North Atlantic 



S. Indian & S. 
Atlantic 



West Coast 
NA & Eastern 
Pacific 



Indian Ocean 


Day/Night 

RMSD 

day&night 

0.75 

day 

0.73 

night 

0.77 

day&night 

0.56 

day 

0.49 

night 

0.59 

day&night 

0.82 

day 

0.74 

night 

0.86 

day&night 

1.59 

day 

1.79 

night 

1.21 

day&night 

0.69 

day 

0.67 ^ 

night 

0.71 

day&night 

0.71 

day 

0.71 

night 

0.72 

day&night 

0.70 

day 

0.67 



0.02 0.31 


-0.05 0.31 


0.08 0.28 


0.33 0.26 


0.25 1.16 


0.38 0.22 


-0.17 0.39 


-0.15 -0.07 


-0.18 0.50 


0.32 0.43 


0.43 0.61 


0.15 -0.06 


0.10 - 0.20 


0.07 0.35 


0.14 -0.25 


-0.11 0.51 


-0.18 -0.11 


0.10 0.19 


0.48 3.. 48 


0.54 -2.24 


observations 


8894 


4393 


4501 


1814 


653 


1170 


3023 


1196 


1827 


193 


116 


77 


879 


499 


380 


2332 


1732 


600 


37 


15 



Table 4 































































































REGION 


Global 



Eastern Trop. 
Pacific 



East Coast 
NA & G.O.M 



North Atlantic 



S. Indian & S. 
Atlantic 



West Coast 
NA & Eastern 
Pacific 



Day/Night 

RMSD 

day&night 

0.78 

day 

0.72 

night 

0.82 

day&night 

0.63 

day 

0.51 

night 

0.66 

day&night 

0.82 

day 

0.71 

night 

0.88 

day&night 

0.92 

day 

0.75 

night 

1.02 

day&night 

0.74 

day 

0.73 

night 

0.75 

day&night 

0.76 

day 

0.74 

night 

0.77 

day&night 

1.1 

day 

1.19 


1.04 



0.05 0.32 


-0.04 0.33 


0.10 0.29 


0.36 -0.22 


0.25 1 .92 


0.39 -0.15 


-0.18 0.52 


-0.17 -0.10 


-0.18 0.66 


0.14 0.21 


-0.05 -0.05 


0.28 0.16 


0.26 -0.12 


0.25 0.24 


0.27 -0.22 


0.0 0.54 


-0.14 


0.11 


0.95 


1.02 


0.91 


- 0.20 


0.41 


- 1.88 


11.32 


observations 


10875 


4162 


6713 


1764 


380 


1384 


3651 


1351 


2300 


590 


245 


345 


787 


441 


346 


3080 


1406 


1674 


43 


18 























































































